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(54) Video decoder 



(57) A video decoder having an input buffer for re- 
ceiving an encoded and compressed data stream, pars- 
ing circuitry for removing header information from said 
data stream circuitry for decoding said data stream, cir- 
cuitry for decompressing said data stream, circuitry for 



selecting predetermined portions of preselected frames, 
memory for storing said decompressed data stream and 
selected portions of said preselected frames, and cir- 
cuitry for reconstructing selected portions of said prese- 
lected frames. 
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Description 

FIELD OF THE INVENTION 

This invention generally relates to improvements in the field of digital signal processing, and more particularly, to 
reduced memory video decoder circuits and methods. 

BACKGROUND OF THE INVENTION 

International standardization committees have been working on the specification of the coding methods and trans- 
mission formats for several compression algorithms to facilitate world wide interchange of digitally encoded audiovisual 
data. The Joint Photographic experts Group (JPEG) of the International Standards Organization (ISO) specified an 
algorithm for compression of still images. The ITU (formerly CCITT) proposed the H.261 standard for video telephony 
and video conference. The Motion Pictures Experts Group (MPEG) of ISO specified a first standard, MPEG-1, which 
is used for interactive video and provides a picture quality comparable to VCR quality. MPEG has also specified a 
second standard, MPEG-2, which provides audiovisual quality of both broadcast TV and HDTV Because of the wide 
field of applications MPEG-2 is a family of standards with different profiles and levels. 

The JPEG coding scheme could in principal also be used for coding of images sequences, sometimes described 
as motion JPEG. However, this intraframe coding is not efficient because the redundancy between successive frames 
is not exploited. The redundancy between succeeding frames can be reduced by predictive coding. The simplest pre- 
dictive coding is differential interf rame coding where the difference between a current pixel of the present frame and 
the corresponding pixel of the previous frame is quantized, coded and transmitted. To perform such interf rame predic- 
tion a frame memory for storing one or more frames is required to allow for this pixel by pixel comparison. Higher 
efficiency than the simple differential interframe coding can be achieved by a combination of discrete cosine transform 
(DCT) and interframe prediction. For so-called hybrid coding the interframe difference, which is similar to JPEG, is 
obtained, DCT coded and then transmitted. In order to have the same prediction at both the receiver and transmitter 
the decoder is incorporated into the coder. This results in a special feedback structure at the transmitter which avoids 
coder-decoder divergence. 

Variable word length coding results in a variable bit rate which depends on image content, sequence change, etc. 
Transmission of the coded information over a constant rate channel requires a FIFO buffer at the output to smooth the 
data rate. The average video rate has to be adjusted to the constant channel rate. This is performed by controlling the 
quantizer according to the buffer content. If the buffer is nearly full, the quantization is made more severe and thus the 
coded bitrate is reduced. Conversely, if the buffer is nearly empty, the quantization is relaxed. 

In general, the MPEG coding use a special predictive coding strategy The coding starts with a frame which is not 
differentially coded; it is called an Intra frame (I). Then prediction is performed for coding one frame out of every M 
frames. This allows computation of a series of predicted frames (P), while "skipping'* frames between coded frames. 
Finally the "skipped" frames are coded in either a forward prediction mode, backward prediction mode, or bidirectional 
prediction mode. These frames are called bidirectionally interpolated (B) frames. The most efficient prediction mode, 
in terms of bitrate, is determined by the encoder and its selected mode is associated with the coded data. Thus the 
decoder can perform the necessary operations in order to reconstruct the image sequence. A main difference between 
MPEG-1 and MPEG-2 is that MPEG-1 has been optimized for non-interlaced (progressive) format while MPEG-2 is a 
generic standard for both interlaced and progressive formats. Thus, MPEG-2 includes more sophisticated prediction 
schemes. 

In more detail, motion pictures are provided at twenty-five to thirty frames per second to create the illusion of 
continuous motion. Since each picture is made up of thousands of pixels, the amount of storage necessary for storing 
even a short motion sequence is enormous. As higher and higher definitions are desired, the number of pixels in each 
picture grows also. This means that the frame memory used to store each picture for interframe prediction also grows; 
current MPEG systems use about 16 megabits (MB) of reference memory for this function. Fortunately lossy com- 
pression techniques have been developed to achieve very high data compression without loss of perceived picture 
quality by taking advantage of special properties of the human visual system. (A lossy compression technique involves 
discarding information not essential to achieve the target picture quality to the human visual system). An MPEG decoder 
is then required to reconstruct in real time or nearly real time every pixel of the stored motion sequence; current MPEG 
decoders use at least about 16 MB of frame memory for reconstruction of frames using the encoded interframe pre- 
diction data. 

The MPEG standard specifies both the coded digital representation of video signal for the storage media, and the 
method for decoding to achieve compatibility between compression and decompression equipment. The standard 
supports normal speed playback, as well as other play modes of color motion pictures, and reproduction of still pictures. 
The standard covers the common 525- and 625-line television, personal computer and workstation display formats. 
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The MPEG-1 standard is intended for equipment supporting continuous transfer rate of up to 1.5 Mbits per second, 
such as compact disks, digital audio tapes, or magnetic hard disks. The MPEG-2 standard supports bit rates from 4 
Mbits/sec (Mbits) to 15 Mbits a disk targeted for equipment that complies with the International Radio Consultative 
Committee (CCIR) recommendation 601 (CCIR-601). The MPEG standard is intended to support picture frames at a 

s rate between 24 Hz and 30 Hz. ISO-11171 entitled "Coding for Moving Pictures and Associated Audio for digital storage 
medium at 1.5 Mbit/s," provides the details of the MPEG-1 standard. ISO-13838 entitled "Generic Coding of Moving 
Pictures and Associated Audio" provides the details of the MPEG-2 standard. 

Under the MPEG standard, the picture frame is divided into a series of "Macroblock slices" (MBS), each MBS 
containing a number of picture areas (called "macrobiocks") each covering an area of 16x16 pixels. Each of these 

io picture areas is represented by one or more 8x8 matrices which elements are the spatial luminance and chrominance 
values. In one representation (4:2:2) of the macroblock, a luminance value (Y type) is provided for every pixel in the 
16x16 pixels picture area (in four 8x8 "Y" matrices), and chrominance values of the U and V (i.e., blue and red chromi- 
nance) types, each covering the same 16x16 picture area, are respectively provided in two 8x8 "LT and two 8x8 "V" 
matrices. That is, each 8x8 U or V matrix covers an area of 8x16 pixels. In another representation (4:2:0), a luminance 

15 value is provided for every pixel in the 16x16 pixels picture area, and one 8x8 matrix for each of the U and V types is 
provided to represent the chrominance values of the 16x16 pixels picture area. A group of lour continuous pixels in a 
2x2 configuration is called a "quad pixel"; hence, the macroblock can also be thought of as comprising 64 quad pixels 
in an 8x8 configuration. 

The MPEG standard adopts a model of compression and decompression shown in Figure 1. As shown in Figure 

20 1 , interframe redundancy (represented by block 101 ) is first removed from the color motion picture frames. To achieve 
interf rame redundancy removal, each frame is designated either "intra" "predicted" or "interpolated" for coding purpose. 
Intra frames are least frequently provided, the predicted frames are provided more frequently than the intra frames, 
and all the remaining frames are interpolated frames. The values of every pixel in an intra frame ("l-picture") is inde- 
pendently provided. In a prediction frame ("P-picture"), only the incremental changes in pixel values from the last I- 

25 picture or P-picture are coded. In an interpolation frame ("B-picture"), the pixel values are coded with respect to both 
an earlier frame and a later frame. Again, large (16 MB) frame or reference memories are required to store frames of 
video to allow for this type of coding. 

The MPEG standard does not require frames to be stored in strict time sequence, so that the intraframe from which 
a predicted frame is coded can be provided in the picture sequence either earlier or later in time from the predicted 

30 frame. By coding frames incrementally, using predicted and interpolated frames, much interframe redundancy can be 
eliminated which results in tremendous savings in storage requirements. Further, motion of an entire macroblock can 
be coded by a motion vector, rather than at the pixel level, thereby providing further data compression., 

The next steps in compression under the MPEG standard remove intraframe redundancy. In the first step, repre- 
sented by block 102 of Figure 1, a 2-dimensional discrete cosine transform (DCT) is performed on each of the 8x8 

35 values matrices to map the spatial luminance or chrominance values into the frequency domain. 

Next, represented by block 103 of Figure 1 , a process called "quantization" weights each element of the 8x8 matrix 
in accordance with its chrominance or luminance type and its frequency. In an l-picture, the quantization weights are 
intended to reduce to one many high frequency components to which the human eye is not sensitive. In P- and B- 
pictures, which contain mostly higher frequency components, the weights are not related to visual perception. Having 

40 created many zero elements in the 8x8 matrix, each matrix can now be represented without information loss as an 
ordered list of a "DC" value, and alternating pairs of a non-zero "AC" value and a length of zero elements following the 
non-zero value. The list is ordered such that the elements of the matrix are presented as if the matrix is read in a zigzag 
manner (i.e., the elements of a matrix A are read in the order A00, A01 , A10, A20, A11, A02, etc.). The representation 
is space efficient because zero elements are not represented individually. 

45 Finally, an entropy encoding scheme, represented by block 104 in Figure 1 , is used to further compress the rep- 

resentations of the DC block coefficients and the AC value-run length pairs using variable length codes. Under the 
entropy encoding scheme, the more frequently occurring symbols are represented by shorter codes. Further efficiency 
in storage is thereby achieved. 

Decompression under MPEG is shown by blocks 105-108 in Figure 1. In decompression, the processes of entropy 

50 encoding, quantization and DCT are reversed, as shown respectively in blocks 105-107. The final step, called "absolute 
pixel generation" (block 108), provides the actual pixels for reproduction, in accordance to the play mode (forward, 
reverse, slow motion etc.), and the physical dimensions and attributes of the display used. Again, large (16 MB) frame 
or reference memories are required to store frames of video to allow for this type of reproduction. 

Since the steps involved in compression (coding) and decompression (decoding), such as illustrated for the MPEG 

55 standard discussed above, are very computationally intensive and require large amounts of memory, for such a com- 
pression scheme to be practical and widely accepted, the decompression processor must be designed to provide 
dec rom press ion in real time, and allow economical implementation using today's computer or integrated circuit tech- 
nology. 
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Improvements in circuits, integrated circuit devices, computer systems of all types, and methods to address all the 
just-mentioned challenges, among others, are desirable, as described herein. 

SUMMARY OF THE INVENTION 

• 5 

Generally, and in one form of the present invention, an MPEG 2 video decoder having an input buffer for receiving 
an encoded and compressed data stream, parsing circuitry for removing video header information from said data 
stream, circuitry for decoding said data stream, circuitry for decompressing said data stream, circuitry for selecting 
predetermined portions of preselected frames, memory for storing said decompressed data stream and selected por- 
to tions of said preselected frames, and circuitry for reconstructing selected portions of said preselected frames is pro- 
vided. 

The present invention also provides a method for reducing the amount of memory for storing video pictures, by 
determining if the amount of video memory needs to be reduced, and selectively decimating preselected frames of 
said video picture to reduce their frame size thereby reducing the amount of memory required to store said preselected 

is frames if the amount of video memory needs to be reduced. 

In another form of the present invention, a method for video decoding, consisting of, receiving an encoded and 
compressed data stream, parsing header information from said encoded and compressed data stream, decoding and 
decompressing the parsed data stream, selectively decimating selected frames to reduce frame size, and storing the 
reduced frame size is provided. 

20 The present invention provides an integrated circuit having an input buffer for receiving an encoded and com- 

pressed data stream, parsing circuitry for removing video header information from said data stream, circuitry for de- 
coding said data stream, circuitry for decompressing said data stream, circuitry for selecting predetermined portions 
of preselected frames, memory for storing said decompressed data stream and selected portions of said preselected 
frames, and circuitry for reconstructing selected portions of said preselected frames. 

25 Other improved IC devices, systems and methods are also claimed. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The invention may be understood by reference to the detailed description which follows, read in conjunction with 
30 the accompanying drawings in which: 

Figure 1 is a model of known compression and decompression processes under the MPEG standard; 
Figure 2 is a simplified electrical block diagram of an embodiment of an improved MPEG video decoder according 
to the present invention; 

Figure 3 is a partial block diagram indicating the portion of Figure 2 needed for a step of a method of the present 
invention; 

Figure 4 is a partial block diagram indicating the portion of Figure 2 needed for a step of a method of the present 
invention; 

Figure 5 is a partial block diagram indicating the portion of Figure 2 needed for a step of a method of the present 
invention; 

Figure 6 is a partial block diagram indicating a process for reducing frame size for selected frames; 
Figure 7 is a partial block diagram indicating a process for reducing frame size for selected frames; 
Figure 8 is a partial block diagram indicating the portion of Figure 2 needed for a step of a method of the present 
invention; 

Figure 9 is a partial block diagram indicating a process for restoring frame size for selected frames; and 
Figure 10 is a partial block diagram indicating a process for restoring frame size for selected frames. 

DETAILED DESCRIPTION 

so Referring initially to Figure 2, there may be seen a block diagram of an improved video decoder architecture 1000 

of the present invention. In Figure 2, incoming coded video 1020 is received in a memory interface 1030 (input buffer) 
which outputs the video bitstream to a block of memory 1025, which includes a section partitioned and dedicated as 
a bitstream memory 1040, where it is temporarily stored. Memory 1025 is preferably SDRAM, but may be any type of 
memory, including but not limited to DRAM, EDO, Flash, or other types of memory. Memory 1025 is used for storing 

55 an encoded and compressed data stream, and as noted later herein, is also used to store decoded and decompressed 
data streams and selected portions of preselected frames in a partitioned image section 1160. 

The stored bitstream is output through the memory interface 1030 to a FIFO 1050. FIFO 1050 in turn passes the 
bitstream to a control logic block 1060, which includes header parser logic that is preferably implemented as a header 
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parser state machine 1 065, which removes the header information from the bitstream. The header parser state machine 
is preferably implemented as sequential logic configured to realize the requisite functions. The video bitstream (less 
the header information) is then passed back to FIFO 1050. That is, FIFO 1050 is an input buffer for receiving an encoded 
and compressed data stream. 

s The header information is utilized by the state machine 1065 to develop bitstream decode control information that 

is passed to a bitstream decode control storage 10S0 f that is prelerably included as part of control logic 1060. The 
control logic 1060 uses this bitstream decode control information to control further processing of the video bitstream, 
as described later herein, preferably though decode control logic 1070, which is preferably implemented as a decode 
control state machine 1070. The decode control state machine is preferably implemented as sequential logic configured 

10 to realize the requisite functions. That is, control logic 1060 provides parsing circuitry for removing video header infor- 
mation from said data stream. 

Continuing to refer to Figure 2, the video bitstream is passed from FIFO 1050 to a variable length decoder (VLD) 
block 1090, which preferably performs Huffman decoding. That is, variable length decoder (VLD) block 1090 is circuitry 
for decoding said data stream. 

15 The decoded video bitstream is then passed to a scan line conversion logic circuit 1100, which coverts the serial 

data stream into an 8 by 8 array of pixels. The scan line conversion logic passes the 8 by 8 array of pixels of the video 
bitstream to a 2D memory 1110. 2D memory 1110 preferably stores the 8 by 8 array of pixels and is a small portion of 
local memory; memory 1110 may be implemented as any type of convenient temporary storage circuit, such as for 
example, but not limited to, an appropriately sized buffer circuit. 

20 An inverse quantization and mismatch control circuit 1120 retrieves the array of the video bitstream from the 2D 

memory 1110 and performs inverse quantization or dequantization on the bitstream; that is, the coefficients that resulted 
from the prior DCT are reconstructed and placed in a 2D array in preparation for the IDCT block 1130. In addition, the 
mismatch logic portion compensates the pixels for known degradation of pixel quality resulting from the use of the fixed 
length code and thus introducing rounding errors in the pixels. 

25 The bitstream is then passed on to a 2D inverse discrete cosine transform circuit (IDCT) 1130 where an inverse 

discrete cosine transform is performed on the bitstream resulting in a restored 8 by 8 array of pixels of the video 
bitstream for intra frames or differences for predicted frames. That is, the 2D inverse discrete cosine transform circuit 
(IDCT) 1130 maps the bitstream from frequency space into the display space using these 8 by 8 arrays. 

The restored video array is passed to a buffer 1135 which accumulates four 8 by 8 arrays to form a 16 by 16 

30 macroblock that a motion compensation circuit 1140 employs to reconstruct a full frame. The motion compensation 
circuit 1140 reconstructs the full frame for P frames and B frames from these macroblocks using motion vectors and 
past and/or future frames stored in image memory 1160. The motion compensation circuit 1140 also uses a half -pixel 
interpolation circuit 1150 to provide needed frame pixel data for reconstruction of a frame or portions of a frame. The 
fully restored and interpolated video bitstream is stored in the image memory 1160 via the memory interface 1030, if 

3S it is part of an I frame or P frame. If it is part of a B frame, control logic 1060 passes the bitstream to decimation logic 
1170 where it is selectively decimated and then stored in image memory 1160, via memory interface 1030. In this 
manner, the decoder 1 000 of the present invention reduces the amount ol memory 1 025 required to store the B frames. 
That is, decimation logic 1170 is circuitry for selecting predetermined portions of preselected frames. 

More particularly, decimation logic 1170 takes a 2D block of image data as an input and reduces the size in the 

40 horizontal and/or vertical direction to reduce the amount of storage required for a B frame. Although the decoder 1000 
of the present invention is described herein in reference to reduced memory storage for a B frame, clearly this technique 
may be applied to any type of frame, and use with one or more of the other types of frames is considered within the 
scope of the present invention. For a vertical reduction, decimation logic 1170 may eliminate every other line of image 
data. This may be accomplished by using a line buffer that under appropriate control of certain control signals discards 

45 every other line. For a horizontal reduction, decimation logic 1170 may eliminate every other pixel in a line of image 
data. This may be accomplished by using a line buffer that under appropriate control of certain control signals discards 
every other pixel. 

For playback of the I or P frame, control logic 1060, via appropriate control signals (not depicted), ensures the 
frame stored in image memory 1160 is passed to the conversion circuit or logic 11 90 which outputs a CCIR-601 video 
so data stream. More particularly, the output is in a byte serial CCIR-601 format; the decoder of the present invention 
supports both interlaced and non-interlaced applications. A synch signal, which indicates the beginning of a frame, 
can be generated by the decoder 1000 as an output signal, or may be provided by external display equipment as an 
input signal to decoder 1000. 

For playback of the B frame the partial frame stored in image memory 1160 is passed to the horizontal and vertical 
55 upsampling circuit 1180 where the decimation is recovered and then to the conversion circuit 1190 which outputs a 
CCIR-601 video data stream. That is, horizontal and vertical upsampling circuit 1180 is circuitry for reconstructing 
selected portions of said preselected frames. 

More particularly, the horizontal and vertical upsampling circuit 1180 takes a 2D block of image data as an input 
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and restores the size tn the horizontal and/or vertical direction back to the original frame size for a B frame. Although 
the decoder 1000 of the present invention is described herein in reference to reduced memory storage for a B frame, 
clearly this technique may be applied to any type of frame, and use with one or more of the other types of frames is 
considered within the scope of the present invention. For a vertical reduction, horizontal and vertical upsampling circuit 
s 1180 may add every other line of image data. For a horizontal reduction, the horizontal and vertical upsampling circuit 
1180 may add every other pixel in a line of image data. The horizontal and vertical upsampling logic 1180 restores the 
reduced image to its full size. Depending on how the image was decimated this block performs the inverse upsampling 
operation with one or both of the following filters: a vertical 1 to 2 upsampling filter, and a horizontal 1 to 2 upsampling 
filter. 

10 Alternatively, the order of the horizontal and vertical upsampling logic 1180 and the conversion logic 1190 may be 

reversed and still be within the scope of the present invention. 

Control logic block 1 060 controls the overall operation of the components of decoder 1 000 to operate in the manner 
described above. Control logic block 1 060 receives as inputs clock signals, interrupt signals, reset signals, test signals, 
and other control input signals, such as control signals from a host processor (not depicted), via the host interface (I/ 

is F) 1062 portion of control logic block 1060. 

Thus, it may be seen that the present invention provides a decoder having an input buffer for receiving an encoded 
and compressed data stream, parsing circuitry for removing header information from said data stream, circuitry for 
decoding said data stream, circuitry for decompressing said data stream, circuitry for selecting predetermined portions 
of preselected frames, memory for storing said decompressed data stream and selected portions of said preselected 

20 frames, and circuitry for reconstructing selected portions of said preselected frames. 

It may also be seen that the present invention provides circuitry that allows for reducing the amount of memory 
for preselected frames. One representative example of when it may be appropriate to reduce the amount of memory 
for frame storage is when an on screen display (OSD) is present. For this case, the control logic 1060 determines that 
OSD data is present and then decimates preselected frames to free up memory for storing the OSD data; the amount 

25 of decimation may be appropriately selected in advance by a user providing appropriate signals to the control logic 
1060. That is, the decimation may be only for the horizontal or vertical direction which reduces memory requirements 
by half, or it may include both horizontal and vertical decimation which reduces memory requirements to one fourth 
that previously needed. 

Thus, it may be seen that the present invention provides a method for reducing the amount of memory for storing 

30 video pictures, by determining if the amount of video memory needs to be reduced, and selectively decimating prese- 
lected frames of said video picture to reduce their frame size thereby reducing the amount of memory required to store 
said preselected frames if the amount of video memory needs to be reduced. 

Referring now to Figure 3, there may seen a partial block diagram indicating the portion of Figure 2 needed for an 
initial step of a method of the present invention which consists of parsing header information from an encoded and 

35 compressed data stream. Figure 3 includes an additional FIFO 1052 : which may different from or the same as FIFO 
1050, that receives the parsed data stream. The first step is receiving the encoded and compressed data stream, after 
which it is parsed. The header information is appropriately stored for use by control logic that determines how the data 
stream is decoded and decompressed. 

Referring now to Figure 4, there may seen a partial block diagram indicating the portion of Figure 2 needed for 

^o the next step of a method of the present invention which consists of decoding and decompressing the parsed data 
stream. Figure 4 also includes additional FIFO 1052, which may different from or the same as FIFO 1050. 

Referring now to Figure 5, there may seen a partial block diagram indicating the portion of Figure 2 needed for 
the next step of a method of the present invention which consists of selecting frames for reducing their frame size and 
then storing the reduced frame size. 

45 Referring now to Figure 6, there may seen a partial block diagram indicating the process 6000 for reducing frame 

size for selected frames, or decimating selected frames. As may be seen in Figure 6, there are a plurality of horizontal 
lines a-h, each containing a plurality of pixels, representative of a frame. In one case alternate lines a, c, e, g are kept 
and in another case alternate lines b, d, f, h are kept. It may be seen that this reduction in frame size results in cutting 
the amount of storage for this frame by half. 

so Referring now to Figure 7, there may be seen a partial block diagram indicating the process for reducing frame 

size for selected Irames, or decimating selected frames. As may be seen in Figure 7, there are a plurality of pixels a- 
h, in a horizontal line. In one case alternate pixels a, c, e, g are kept and in another case alternate pixels b, d, f, h are 
kept. It may be seen that this reduction in frame size results in cutting the amount of storage for this frame by half. 
However, by employing both line and pixel decimation the amount of storage needed for a frame may be reduced to 

55 one fourth that otherwise needed when the method of the present invention is not employed.. 

Referring now to Figure 8, there may seen a partial block diagram indicating the portion of Figure 2 needed for 
the step of a method of the present invention for restoring the stored reduced frame size for preselected frames back 
to their normal frame size for display. 
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Referring now to Figure 9, there may seen a partial block diagram indicating a process for restoring frame size for 
selected frames. As may be seen in Figure 9, there are a plurality of horizontal lines each containing a plurality of 
pixels. In one case 8000 the alternate lines a, c, e, g kept after the decimation of Figure 6 are expanded and in another 
case 8010 the alternate lines b, d, f, h kept after the decimation of Figure 6 are expanded. It may be seen that this 

5 restoration in frame size results in returning this frame to its normal size 8040. Figure 9 depicts a pixel buffer 8022 and 
a line buffer 8020, in addition to an averaging circuit 8030. The averaging circuit receives as its inputs the values of 
two corresponding pixels from two adjacent decimated horizontal lines, such as, for example, but not limited to lines 
a and c of Figure 6, and then averages each pair of pixels to derive a corresponding pixel for the missing or decimated 
horizontal line, such as, for example, but not limited to line b of Figure 6, that needs to be inserted between the two 

10 adjacent decimated horizontal lines before display. In this manner all the pixels down the two adjacent decimated 
horizontal lines are averaged to generate the pixels for the missing or decimated horizontal line. 

Referring now to Figure 10, there may seen a partial block diagram indicating a process for restoring frame size 
for selected frames. As may be seen in Figure 10, there are a plurality of pixels in a horizontal line. In one case 6002 
alternate pixels a, c, e, g kept after the decimation of Figure 7 are expanded and in another case 8004 alternate pixels 

is b, d, f, h kept after the decimation of Figure 7 are expanded. It may be seen that this restoration in frame size results 
in returning this line to its normal size 8042. 

A 6 tap upsampling filter 8042 may be defined by the following equation 

X = (8*Y rt - + 20*Y n - +100*Y n - + 100*Y n + 20*Y nj - +8*Y ~)/256 
2Q n x n-3 n-2 n- 1 n n+ 1 n+z ' 

where X n is the pixel being reconstructed and Y n are the available pixels around the location where X,, will be placed. 
This upsampling filter 8042 may be employed to generate the decimated pixels to restore a horizontal line to its normal 
length before display. Clearly, other types of upsampling filters may be employed in the present invention. 

25 Thus, it may be seen that the present invention provides a method for video decoding, consisting of, receiving an 

encoded and compressed data stream, parsing header information from said encoded and compressed data stream, 
decoding and decompressing the parsed data stream, selectively decimating selected frames to reduce frame size, 
storing the reduced frame size, and restoring the reduced frame size to normal frame size before display. 

However, when both line and pixel decimation have been employed then both restoration processes must be 

30 employed to restore the frame to its normal size before display. 

As an example of typical memory storage amounts for a decoded and decompressed frame of video data, the 
following are representative: 



NTSC 


(full frame) 


518, 400 bytes 


PAL 


(full frame) 


622, 080 bytes 


NTSC 


(half-frame, eg either horizontal or vertical decimation) 


259, 200 bytes 


PAL 


(half-frame) 


31 1 , 040 bytes 


NTSC 


(quarter-frame, eg both horizontal and vertical ecimation) 


129, 600 bytes 


PAL 


(quarter-frame) 


155, 520 bytes 



While this invention has been described with reference to illustrative embodiments, this description is not intended 
to be construed in any limiting sense. Various modifications of the illustrative embodiments, as well as other embodi- 
ments of the invention, may be made and will be apparent to persons skilled in the art upon reference to this description. 

45 

Claims 

1. A video decoder, comprising: 

so 

an input buffer for receiving an encoded and compressed data stream, 
parsing circuitry for removing video header information from said data stream, 
circuitry for decoding said data stream, 
circuitry for decompressing said data stream, 
55 circuitry for selecting portions of a preselected frame of video data comprised in said data stream, 

a memory for storing said decompressed data stream and said selected portion of said preselected frame, and 
circuitry for reconstructing selected portions of said preselected frame. 
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A method for reducing the amount of memory for storing video images, comprising: 
determining if the amount of video memory needs to be reduced, and 

selectively decimating preselected frames of said video images to reduce their frame size thereby reducing 
the amount of memory required to store said preselected frames if the amount of video memory needs to be 
reduced. 

The method of claim 2, wherein said determining step, comprises, determining if OSD data is present. 

The method of claim 2, wherein said determining step, comprises, determining if program memory is needed. 

A method for video decoding, comprising: 

receiving an encoded and compressed data stream, 

parsing header information from said encoded and compressed data stream, 
decoding and decompressing the parsed data stream, 

selectively decimating selected frames of video data from said data stream to reduce frame size, and 
The method of Claim 5, further comprising, 

restoring the reduced frame size to normal frame size before display 



8 



■1 



EP 0 827 344 A2 

















101 




102 
/ 


/ UJ> 

<> 




1 n a 

I U4 






INTERFRAME 
REDUNDANCY 
REMOVAL 




OCT 




QUANTIZATION 




ENCODING 




108 

/ 




107 
/ 


106 
/ 




105 






ABSOLUTE 

PIXEL 
GCNCRATION 




IDCT 




DE- 
QUANTIZATION 




DECODING 





Fig. 1 PRIOR ART 



VIDEO 
BITSTREAM 



T 



1030 



MEMORY l/f 



1020 
1040 

MEMORY 
f 



1025 



1 



BITSTREAM 
IMAGE 



1160 

I) 



1000 



1150 



DECIMATION 
LOGIC 



HALF PEL 
INTERPOLATION 



1140 



1050 



1155 



BUFFER „ 



1170 

1150 

\ 1120 

I 



2D 



MOTION 
CONPENSATION 



FIFO 



1090 



VLD 



1100 



SCAN LINE 
CONVERSION 
LOGIC 



IDCT 



INVERSE 
QUANTIZER 
AND MIS- 
MATCH 
CONTROL 



T 



2D MEMORY 



\ , 



CONTROL LOGIC 1 060 
--~~~~~~i~~ZZ — <~ZZZIZZ "t 



HEADER 

PARSER 

(STATE 
MACHINi 



1065 



BITS1REAM 
DECODE 
CONTROL 
STORACr 

) 

/ 080- 1070 



DECODE 
CONTROL 
(STATE 

MACHINE) | j= 



U 
• o 

I ~T 
i 



1110 



/ / 80 



HORIZONTAL 
& VERTICAL 
UPSAWPLING 
LOGIC 



O.O 10 4:7:2 
CONVERSION 
LOGIC 



Ho. 



? 



T 



can 

GO I 
V!D! 0 
!JA I A 



/ / 90 



9 



EP 0 827 344 A2 



2. 



MEMORY l/F 



FIFO 



-TfFoI compr £ssed image 

1 1 DATA 



8ITSTREAM 
MEMORY 



HEAOER PARSER 
STATE MACHINE 
7 



8ITSTREAW DECODE CONTROL 
INFORMATION STORAGE 



Fig. 3 



) )oo-> 



FIFO | ^~VL0 



SCAN LINE 
CONVERSION 
LOGIC 



2D MEMORY \ 



IMAGE 
MEMORY 



MEMORY 

l/F 
T 



HALF-PEL 
INTERPOLATION 



W3a 



20 I0CT 



li>o 



INVERSE QUANTIZATION 
AND MISMATCH CONTROL 



MOTION 
COMPENSATION 



\ 1 / \*** 



BITSTREAM DECODE CONTROL 
INFORMATION STORAGE 



IMAGE 




MEMORY 


MEMORY 




'A 



Fig. 4 

i MOTION 
COMPENSATION 



^CONTROL 
LOGIC 



DECIMATION 
LOGIC 



IV 7 



Fig. 5 



10 



1 1 1 

EP 0 827 344 A2 




4. 



a 
c 



OR 



3= 



/7#. 6 
G ° ' ° f 



2 ^ 0 3*p> 



IMAGE 




MEMORY 




MEMORY 




i/r 





\\e>o •> 



HORIZONTAL AND 
VERTICAL 
UPSAMPLING 



CONTROL 
LOGIC 



4:2:0 TO 4:2:2 
CONVERSION 



CCIR601 VIOEO 
"OATA 







LINE BUFFER ^> 



OR £o»o^ 



pixel surrcR 



AvTr 



8<2 °^N ) 

or ^ 



6 TAP 
UPSAMPLING 
MUCH 




11 



This ?§g$ Blank (uspto) 



